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DETAILED ACTION 

1 . This action is in response to the amendment filed on: 07/23/2007. 

2. Claims 7, 13, 15, 19, 21, 22, 23 have been amended. Claims 1, 3, 4, 8, 11, 12, 
14, 17, 18, and 20 are cancelled. Claims 9, 13, 15, 21, and 23 are independent claims. 
Claims 2, 5-7, 9, 10, 13, 15, 16, 19, 21-26 are pending. 

3. The 35 USC 112 second rejections with respect to claims 7 and 22 are 
withdrawn, in view of applicant's amendment. 

4. With respect to claims 13, and 19 rejected under 35 U.S.C. 102(e) as being 
anticipated by Price et al, claims 9, 10, 15, and 16 rejected under 35 U.S.C. 103(a) as 
being unpatentable over Price et al, in further view of Madduri, claims 5-7, and 21-25 
are rejected under 35 U.S.C. 103(a) as being unpatentable over Price et al, in further 
view of Wilcox et al, claim 2 rejected under 35 U.S.C. 103(a) as being unpatentable 
over Price et al, and Wilcox et al, in further view of Schilit et al, claim 26 rejected under 
35 U.S.C. 103(a) as being unpatentable over Price et al, and Wilcox et al, in further view 
of Madduri et al; they are withdrawn, in view off applicant's amendment. 

Drawings 

5. The drawings filed on: 09/07/04 are accepted. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
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invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claim 2 is rejected under 35 U.S.C. 103(a) as being unpatentable over Price et al 
(US Patent: 6,766,494 B1, issued: Jul. 20, 2004, filed: Jun. 15, 1998), Schilit etal (US 
Patent: 6,687,876, issued: Feb. 3, 2004, filed: Dec. 30, 1998), and Wilcox et al (US 
Patent: 5,592,568, issued: Jan.7, 1997, filed: Feb. 13, 1995), in further view of Schilit et 
al (US Patent: US 6,279,014 B1, issued: Aug. 21, 2001, filed: Sep. 15, 1997) 

With regards to claim 2, which depends on claim 23, Price et al and Wilcox et al 
teaches teaches wherein said at least one of said clips, as explained in the rejection for 
claim 23, and is rejected under the same rationale. 

However, Price et al and Wilcox et al do not expressly teach wherein said clips includes 
additional content. 

Schilit et al teaches clips containing additional content: whereas each clip comprises a 
context portion (Schilit et al, column 6, lines 45-50), and addition content information, 
such as attributes concerning the type (column 7, lines 23-26), identified content 
(column 7, lines 27-30), or time/date data (column 7, lines 35-39). 

It would have been obvious to one of the ordinary skill in the art at the time of the 
invention to have modified Price et al, Schilit et al (Patent: 6,687, 876), and Wilcox et 
al's clips, such that they contain the additional information, as taught by Schilit et al. The 
combination would have allowed Price et al to have implemented "an annotation system 
for electronic documents ... with quick accessibility" (Schilit et al, column 3, lines 10-15) 

7. Claims 5-7, and 21-25 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Price et al (US Patent: 6,766,494 B1, issued: Jul. 20, 2004, filed: Jun. 
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15, 1998), and Schilit et al (US Patent: 6,687,876, issued: Feb. 3, 2004, filed: Dec. 30, 
1998), in further view of Wilcox et al (US Patent: 5,592,568, issued: Jan. 7, 1997, filed: 
Feb. 13, 1995). 

With regards to claim 5, which depends on claim 23, Price et al teaches wherein 
a storage storing said annotation and an image of the first content associated with the 
annotation (column 5, lines 59-67, and column 6, lines 1-20: whereas, images, which 
include the first content associated with the annotation, and the ink annotation, is stored 
in a database). 

With regards to claim 6, which depends on claim 23, Price et al teaches a 
storage storing said annotations and a link to said content (column 6, lines 1-20). 

With regards to claim 7, which depends on claim 23, Price et al teaches a 
storage storing said annotations and an active of the first content associated with the 
annotation, and wherein the first content changes over time (column 6, lines 1-20: 
whereas the first content includes ink strokes from the time of the beginning of a 
sequence ink points, till the end of the sequence of ink points over time). 

With regards to claim 21 , Price et al teaches a system comprising: 
An input for receiving annotations associated with content, as similarly explained in the 
rejection for claim 13, and is rejected under similar rationale. 

A processor for creating a renderable image having clips, wherein at least one of said 
clips is a combination of two or more annotations and their associated content (Figure 4: 
whereas a clip includes two annotations and associated content), said processor 
executing instructions including: 



Application/Control Number: 10/777,046 _ Page 5 

Art Unit: 2178 

Encompassing first content and an associated annotation in a first bounding box 
(Figure 4: whereas, first content and associated annotation is retrieved for a particular 
page (page 4 in the figure), such that a first bounding box is implemented). 

Encompassing second content and an associated annotation in a second 
bounding box (Figure 4: whereas second content and associated annotation is retrieved 
for a particular page (page 7 in the figure), such that a second bounding box is 
implemented), wherein the first and second bounding boxes are non-contiguous (Figure 
4: whereas, the first and second bounding boxes, bound content and annotations from 
different pages) 

Outputting said renderable image (Figure 4: whereas a combination of clips are output 
for display in a renderable image/display-image-clip). 

However, Price et al does not expressly teach and the associated content will include a 
user interface to allow various selections of an active content change when since the 
previous renderable image upon the user interface, the active content associated with 
the annotation has changed, and ... based on active content selection, combining the 
first bounding box, and the second bounding box to form one of said clips. 
The combination of Price et al and Schilit et al teaches and the associated content will 
include a user interface to allow various selections of an active content change when 
since the previous renderable image upon the user interface, the active content 
associated with the annotation has changed, and . . . based on active content selection, 
as similarly explained in the rejection for claim 13, and is rejected under similar 
rationale. 
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However, the combination of Price et al and Schilit et al do not teach combining the first 
bounding box, and the second bounding box to form one of said clips. 
Wilcox et al teaches combining the first bounding box, and the second bounding box to 
form one of said clips (Abstract: whereas, bounding boxes enclose image objects based 
on markings/word shape). Additionally, Wilcox et al teaches combining bounding boxes 
should the threshold between their neighbors are within a threshold distance from each 
other in a document (column 19, lines 49-54). 

It would have been obvious to one of the ordinary skill in the art at the time of the 
invention to have modified Price et al's first and second bounding boxes, such that they 
can also have been combined to form a clip, as taught by Wilcox et al. The combination 
of Price et al, Schilit et al, and Wilcox et al would have allowed Price et al to have 
"recognized keywords /strings (combination of smaller entities) without having to detect 
or recognize individual characters making up the strings (thus ultimately processing less 
entities)" (Wilcox et al, column 1, lines 49-51). 

With regards to claim 22, which depends on claim 21, Price et al, Schilit et al, 
and Wilcox et al similarly teach prior to combining the processor executes instructions 
which determine that the first bounding box and the second bounding box are within a 
threshold distance from each other in a document, as similarly explained in the rejection 
for claim 21 , and is rejected under similar rationale. 

Additionally, Price et al also teaches wherein third content without an associated 
annotation is located in a third region located between the first and second regions 
(column 3, lines 65-67, Figures 6A, and 6B: whereas content includes removal of 



Application/Control Number: 10/777,046 . Page 7 

Art Unit: 2178 

associated annotation(s), and also omitted regions in between a first and second region 
are shown in Figure 4.) 

With regards to claim 23, for a system performing a method similar to the method 
performed by the system of claim 21 , is rejected under similar rationale. 

With regards to claim 24, for a system performing a method similar to the method 
performed by the system of claim 22, is rejected under similar rationale. 

With regards to claim 25, which depends on claim 6, Price et al teaches wherein 
said annotations are from different documents (Figure 4: whe,reas, annotations are from 
different pages/documents (pages 4 and 7)). 

8. Claims 9, 10, 15, and 16 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Price et al (US Patent: 6,766,494 B1, issued: Jul. 20, 2004, filed: Jun. 
15, 1998), and Schilit et al (US Patent: 6,687,876, issued: Feb. 3, 2004, filed: Dec. 30, 
1998), in further view of Madduri (US Patent: 6,551,357 B1, issued: Apr. 22, 2003, field: 
Feb. 12, 1999). 

With regards to claim 9, Price et al teaches a method comprising: 
Receiving at least two sets of an annotation and related content, the at least two sets 
being from non-contiguous portions of a document or portions of different documents 
(column 5, lines 31-43: whereas, at least two sets of annotations (each set of anchored 
ink marks are retrieved, based on the type of annotation/ink-anchor selected, as shown 
in Figure 4: whereas, multiple sets of anchored ink marks and their related content are 
retrieved.) 
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Combining said at least two sets to from a combination consisting of non-contiguous 
portions of a document or portions of different documents or both (Figure 4: whereas, a 
combination of at least two sets of anchored ink marks, are combined and displayed on 
the screen (the at least two sets of anchored ink marks are non-contiguous since one 
set appears on page 4, and the other set appears on page 17). 

However, Price et al does not expressly teach ... and the associated content will include 
a user interface to allow various selections of an active content change when since the 
previous renderable image upon the user interface, the active content associated with 
the annotation has changed, filtering said combination of said at least two sets, and 
displaying the filtered combination of said at least two sets. 
Yet, the combination of Price et al and Schilit et al teaches ... and the associated 
content will include a user interface to allow various selections of an active content 
change when since the previous renderable image upon the user interface, as similarly 
explained in the rejection for claim 13, and is rejected under similar rationale. 
However, the combination of Price et al and Schilit et al do not teach filtering said 
combination of said at least two sets, and displaying the filtered combination of said at 
least two sets. 

Madduri et al teaches filtering said combination of said at least two sets, displaying the 
filtered combination of said at least two sets (column 8, lines 31-35, and column 8, lines 
37-44: whereas a user can view a combination of annotated sets (whereas the sets are 
combined into a pool of annotated sets due to selecting a plurality of markup files), and 
further filter the collective combination to block certain sets for viewing). 
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It would have been obvious to one of the ordinary skill in the art at the time of the 
invention to have modified Price et al's set combination, such that the combination can 
be filtered, as taught by Madduri et al. The combination of Price et al, Schilit et al, and 
Madduri et al would have allowed Price et al to have allowed users to "have selectively 
displayed markings generated from other people without altering the underlying text 
document" (Madduri et al, column 3, lines 16-20). 

With regards to claim 10, which depends on claim 9, Madduri et al teaches 
filtering said combination of said at least two sets, as similarly explained in the rejection 
for claim 9, and is rejected under similar rationale. Madduri et al further teaches the 
filtering, further includes retrieving the combination data from a file (column 8, lines 1-7: 
whereas the video controller retrieves selected/filtered combination data from a file). 

With regards to claim 15, for a computer readable medium, having a program 
stored thereon, that performs a method similar to claim 9, is rejected under similar 
rationale. 

With regards to claim 16, for a computer readable medium, having a program 
stored thereon, that performs a method similar to claim 10, is rejected under similar 
rationale. 

9. Claims 13, and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Price et al (US Patent: 6,766,494 B1, issued: Jul. 20, 2004, filed: Jun. 15, 1998), in 
view of Schilit et al (US Patent: 6,687,876, issued: Feb. 3, 2004, filed: Dec. 30, 1998). 
With regards to claim 13, Price et al teaches a method comprising: 
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Receiving data regarding an annotation (column 5, lines 3-25: whereas, sets of ink 
annotations are received) 

Storing a link to context information with said annotation data in a storage (column 6, 
lines 3-20: whereas, links to context information are stored through link databases) 
Storing associations regarding at least two documents from which said annotation 
originates (column 6, lines 1-20: whereas association data between annotations, and 
one or more pages are stored). 

Wherein selection of said annotation accesses the at least two documents to display 
said annotation (column 5, lines 31-39: whereas, a particular annotation is selected, and 
multiple documents are accessed as shown in Figure 4 to display said annotation.) 
However, Price et al does not expressly teach the data will include a user interface to 
allow various selections of an active content change when since the previous access 
session the active content change when since the previous access session the active 
content has changed, and .... Display said annotation based on the active content 
selection. 

Schilit et al teaches the data will include a user interface to allow various selections of 
an active content change when since the previous access session the active content 
change when since the previous access session the active content has changed 
(column 2, lines 56-65: whereas, the active view content changes from the previous 
session, for which a user makes on a user interface) and .... Display said annotation 
based on the active content selection (column 2, lines 56-65: whereas the annotation 
display is updated as the view changes). 
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It would have been obvious to one of the ordinary skill in the art at the time of the 
invention to have modified Price et al's annotation system, such that annotation data is 
with respect to active content change since previous access session, as taught by 
Schilit et al. The combination of Price et al, and Schilit et al would have allowed Price et 
al to have "maintained the indication of relationships between freeform digital ink 
annotations and objects in a view as the view of the annotated objects changes", and 
also to "experience marking on paper to dynamic media" (Schilit et al, column 3, lines 
10-16). 

With regards to claim 19, for a for a computer readable medium, having a 
program stored thereon, Price et al teaches: 

Receiving data regarding an annotation, storing a link to context information with said 
annotation data in a storage, storing associations regarding at least two documents 
from which said annotation originates, wherein selection of said annotation accesses 
the at least two documents to display said annotation, as similarly explained in the 
rejection for claim 13, and is rejected under similar rationale. 

Additionally, Price et al teaches the at least two sets being from non-contiguous portions 
of a document or portion of different documents (column 5, lines 31-43: whereas, at 
least two sets of annotations (each set of anchored ink marks are retrieved, based on 
the type of annotation/ink-anchor selected, as shown in Figure 4: whereas, multiple sets 
of anchored ink marks and their related content are retrieved.)) 
However, Price et al does not expressly teach the data will include a user interface to 
allow various selections of an active content change when since the previous access 
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session the active content change when since the previous access session the active 
content has changed, and .... Display said annotation based on the active content 
selection. 

The combination of Price et al and Schilit et al teach the data will include a user 
interface to allow various selections of an active content change when since the 
previous access session the active content change when since the previous access 
session the active content has changed, and ... Display said annotation based on the 
active content selection, as similarly explained in the rejection for claim 13, and is 
rejected under similar rationale. 

10. Claim 26 is rejected under 35 U.S.C. 103(a) as being unpatentable over Price et 
al (US Patent: 6,766,494 B1, issued: Jul. 20, 2004, filed: Jun. 15, 1998), Schilit etal (US 
Patent: 6,687,876, issued: Feb. 3, 2004, filed: Dec. 30, 1998), and Wilcox et al (US 
Patent: 5,592,568, issued: Jan.7, 1997, filed: Feb. 13, 1995), in further view of Madduri 
etal (US Patent: 6,551,357 B1, issued: Apr. 22, 2003, field: Feb. 12, 1999) 

With regards to claim 26, Price et al, Schilit et al, and Wilcox et al teach said 
documents (as similarly explained in the rejection for claim 23, and is rejected under 
similar rationale). However, Price et al, and Wilcox et al do not expressly teach said 
documents are from different application programs. 

Madduri et al teaches said documents are from different application programs (column 
5, lines 1-16: whereas documents are from different programs such as WordPerfect, 
and Microsoft Word). 
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It would have been obvious to one of the ordinary skill in the art at the time of the 
invention to have modified Price et al, Schilit et al, and Wilcox et al's system, such that 
the system uses documents from different application programs, as taught by Madduri 
et al. The combination of Price et al, Wilcox et al, and Madduri et al would have allowed 
Price et al to have implemented a system with documents "having text in any text format 
known in the art" (Madduri et al, column 5, lines 6-8). 

Response to Arguments 

11. Applicant's arguments with respect to claims 2, 5-7, 9, 10, 13, 15, 16, 21-26 have 
been considered but are moot in view of the new ground(s) of rejection. 

12. With respect to claims 13, and 19, the applicant argues amendment claims 13 
and 19, that Price, Madduri, Wilcox, or Schilit do not remotely suggest/teach "receiving 
data comprising, the data will include a user interface to allow various selections of an 
active content change when since the previous access session the active content has 
changed, and wherein selection of said annotation accesses the at least two document 
s to display said annotation based on the active content selection. However, the cited 
amendment limitation has been shown to be taught , in view of Schilit et al (US Patent 
6,687, 876), as explained in the above rejection. Thus, the applicant's argument is moot 
in view of new grounds of rejection. Further more, with respect to claims 9, 10, 15, and 
16 for being allowable, since amended claim 13 (or other respective independent 
claims) is allowable, is not persuasive, since claim 13, has been shown/explained to be 
rejected. 
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1 3. Additionally, with respect to the claims dependent on one of the independent 
claims, being allowable, since their respective independent claims are allowable, is not 
persuasive since the independent claims have been shown/explained to be rejected. 



14. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Wilson Tsui whose telephone number is (571)272-7596. 
The examiner can normally be reached on Monday - Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen Hong can be reached on (571) 272-4124. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Conclusion 
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